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Abstract 



We give an effective sufficient condition for a variational prob- 
lem with infinite horizon on a compact Riemannian manifold M to 
admit a smooth optimal synthesis, i. e. a smooth dynamical system 
on M whose positive semi-trajectories are solutions to the problem. 
To realize the synthesis we construct a well-projected to M invariant 
Lagrange submanifold of the extremals' flow in the cotangent bundle 
T*M. The construction uses the curvature of the flow in the cotangent 
bundle and some ideas of hyperbolic dynamics. 

1 Introduction 

This paper is dedicated to the 100th anniversary of Lev Semenovich Pon- 
tryagin. 

Let M be a smooth compact n-dimensional Riemannian manifold. Given 
a > 0, we denote by Q a the set of all absolutely continuous curves 



7 : [0, +oo) — > M such that the integral J e _Q *|7(t)| 2 dt converges. Here 

o 

|7(t)| is the Riemannian length of the tangent vector j(t) G T^mM. Given 
q G M, we set ft£ = {7 G fi Q : 7(0) = q}. 

Let U : M — > PR. be a smooth function. We set 
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and try to minimize 3 a on Q®. Given g G M, we say that 70 G Sl^ o is 
a minimizer if 3 Q (7o) = min{J a (7) : 7 G ^g }- We say that 3 a defines a 
well-posed variational problem or admits smooth optimal synthesis if for any 
q G M there exists a unique minimizer 7 g and the map (q,t) 1— > 7 g (i), 9 G 
M, £ > 0, is of class C 1 . 

The functional J is simply the action of a mechanical system on the 
Riemannian manifold M with potential energy U. If a > 0, then 3 a is the 
discounted action with the discount factor a. 

It is not hard to show that 2T does not define a well-posed variational 
problem for generic U . In this paper we prove that 3 a defines a well-posed 
problem for all sufficiently big a. Moreover, we give the effective sharp 
estimate for critical a. 

The functional 3 a admits smooth optimal synthesis if and only if there 
exists a complete vector field V of class C 1 on the manifold M such that 
any positive semi-trajectory 7 of the dynamical system q = V(q) is a unique 
minimizer of 3 a on £l"r y Indeed, assume that 3 a ( , y(-)) = mm{3 a (q(-)) : 
q(-) G then 3 Q ( 7 (s + •)) = mm{3 a (q(-)) ■ ?(0 e H° w } for any s > 0. 

Define V(5o) = 7g (0)! ^ nen 9o ^ ^(?o) is a vector field of class C 1 on M 
and % (s) = F( 7 (s)), Vs>0. 

How to characterize the minimizers? If 7 is a minimizer then, obviously, 

T 

7 minimizes the functional / e~ at {\\q{t)\ 2 - U(q(t)) dt on the space of all 



q(-) G H\[0,T}, M) such that q(0) = q , q(T) = 7 (T) for any T > 0. Hence 
any solution of our infinite horizon variational problem satisfies the Euler- 
Lagrange equation of the classical finite horizon variational problem. 

Let us consider a simple example. Let M = S 1 = R/2irZ and U(9) = 
cos6, 9 G S 1 , the potential energy of the mathematical pendulum. The 
Euler-Lagrange equation has the form: 6 = sin9 + aO . Write it as a system: 

i 6 = ^ • (1) 

This system has 2 equilibrium points: = (0,0) and (9, £) = (7r, 0). The 

equilibrium (0, 0) is a saddle for any ct > 0. The equilibrium (ir, 0) is a center 
for a = (see Fig. 1), unstable focus for < ^- < 1 (Fig. 2), and unstable 
node for ^ > 1 (Fig. 3). 

A solution $(■) of the Euler-Lagrange equation belongs to Q a if and only 
if (£(•)>#(")) is an equilibrium or a part of the stable submanifold of the 
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Figure 4: 

saddle. The saddle and node equilibria are minimizers while the focus and 

2 

center are not. If 4- < 1 then 3 a does not admit smooth optimal synthesis; 

2 

if 2- > 1 then it does admit smooth optimal synthesis. The corresponding to 
the minimizers trajectories of system (1) in both cases are shown on Figure 4. 
In order to formulate our main result we need the following definition. 

Definition 1 The curvature of the Hamiltonian H at z G T*M is a self- 
adjoint linear operator Rf : T*M — ► T*M defined by the formula 

RX( = m{C,z)z + (v 2 q u)(, (gt;m, 

where V is the covariant derivativation and 9i the Riemannian curvature. 

Given a self-adjoint linear operator A on a Euclidean space and a constant 
o6K, the relation A < al means that all eigenvalues of A are smaller than 
a. Now we state the main result of this paper: 

Theorem 1 Let Rf* < ^-1 for any z G T*M such that H(z) < max [/(g); 
then 3 a admits smooth optimal synthesis. 

Corollary 1 Assume that sectional curvature of M does not exceed r > 
and 2 

V 2 q U < - 2r(max U - min U^j I, Wq G M. 

Then 3 a admits smooth optimal synthesis. 

In the next section we use symplectic language to characterize extremals 
of the variational problem and formulate a more detailed version of the main 
result, including its Hamilton- Jacobi interpretation. The discount factor 
appears as a friction coefficient in the extremals' equation and serves as a 
"smoothing factor" in the Hamilton- Jacobi setting. 



4 



In Section 3 we prove the "partial hyperbolicity" of the set filled by the 
extremals; this is a principal step in the proof of the main result. A good 
source for the theory of partially hyperbolic systems is book [3]. It seems 
that this concept is really relevant to our subject: sufficiently strong isotropic 
friction almost automatically leads to the partial hyperbolicity and this fact 
concerns much more general systems than ones studied in this paper. 

In Section 4 we complete the proof of the main result: optimal synthesis 
is obtained as a limit of solutions of the horizon r > problem as r — > +oo. 

In this paper we assume that the manifold M is compact. This assump- 
tion can be substituted by requirements on the asymptotic behavior of the 
Riemannian metric and potential at infinity. In particular, the result remains 
valid for the "asymptotically flat" metrics and "asymptotically quadratic" 
potentials. This and other generalizations (more general Lagrangians, prob- 
lems with nonholonomic constraints) could be subjects of forthcoming pa- 
pers. 

Acknowledgment. I am grateful to Dmitriy Treschev for the stimulating 
discussion. 

2 Symplectic setting 

Let a be the standard symplectic form on T*M, a = ds, where s is the 
Liouville form: s z = z o tt^\ t , T * M y Vz G T*M, and 7r : T*M — > M is the 
standard projection. 

The Hamiltonian (or the energy function) H : T*M —>■ R associated to 
the Lagrangian ||7(£)| 2 - E7(7(t)) is defined by the formula H{z) = §|z| 2 + 
U(ir(z)), ~iz G T*M, where \z\ = max{{z,v) : v G T^^M, \v\ = 1} is the 
dual norm to the norm defined by the Riemannian structure. Actually, the 
Riemannian structure is a self-adjoint isomorphism of TM and T*M and 
in this paper we freely use without special mentioning the provided by this 
isomorphism identification of tangent and cotangent vectors. 

The Legendre transformation of the time-varying Lagrangian 
e~ at (||<?| 2 — U(q)) has the form e~ at H(e at z), hence solutions of the Euler- 
Lagrange equations are exactly projections to M of the trajectories of the 
Hamiltonian system on T*M 




(2) 
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where H is the Hamiltonian vector field associated to H; the field H is defined 
by the identity dH — o~(-, H). Recall that z is a point of the 2n-dimensional 
manifold T*M; local coordinates on M induce local trivialization of T*M so 
that z splits in two n-dimensional vectors, z = (p,q), and 7r : (p,q) h- > g. 

n n 

Then s = s ^p l dq % ) a = ^2 dp 1 A dq l and system (2) takes the form: 
i=i i=i 

f 5 = f (e a V,g) 

I P = -e- at ^(e at p,q) " 
The time-varying change of variables £ = e at p gives the system 

9 = f &?) 

or in the coordinate free form: 

C = #(C) + ae(C), (3) 

where = e a *z(t) and e is the vertical Euler vector field of the vector 
bundle vr : T*M -> M. 

We set f) a = H+ae and denote by e*^ Q , t G M, the flow on T*M generated 
by the vector field f) a . It is easy to see that 

(e*^)*s = e a 's + da t , Vt G R, 

where is a smooth function on T*M, t G R. Indeed, let s f = (e*^)* s; 
then 

-l Si = (e*^)* L^s = (e tf ><*)* d{i s s- H) + as t = db t + as t , 

t 

where b t = (igs — H) o e ti)a . Hence s t = e at so + d J e a ^ T ^b T dr. 

o 

Recall that Lagrange subspaces of T Z (T*M) are n-dimensional isotropic 
subspaces of the form a z , z G T*M, and Lagrange submanifolds of T*M are 
n-dimensional submanifolds whose tangent spaces in all points are Lagrange 
subspaces. In other words, an n-dimensional submanifold C C T*M is a 
Lagrange submanifold if and only if s\ c is a closed form. We say that L is 
an exact Lagrange submanifold if s\ c is an exact form. We obtain that e tf)a 
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transforms (exact) Lagrange sub manifolds of T*M into (exact) Lagrange 
submanifolds. 

More notations. Let q be the origin of the space T*M. We set 

C H = {0 q : d q U = 0, q G M}, 

the set of equilibrium points of system (3), and 

B H = {ze T*M : H{z) < maxfj}. 

In what follows we tacitly assume that a > 0. Note that = 
a|C(t)| 2 for any solution ( of (3). Hence H is strictly monotone increasing 
along any solution that is not an equilibrium. 

Lemma 1 Let ((t) = e tt)a (((0)) be a trajectory of system (3). The following 
statements are equivalent: 

1. vroC(-) G tt a . 

2. ((■) is a bounded curve in T*M. 

3. C(t) G B H , Vt G R. 

Proof. The implications 3 ^ 2^ 1 are obvious. Let us prove that 1 implies 
3. 

Assume that the trajectory ((t), t G R, is not contained in Bh- Then 
we may assume, without lack of generality, that £(0) ^ B H . In other words, 
H(C(0))-maxU > 0. Set fi(t) = H(((t)) -maxU, then ^(0) > 0. We have: 

m = j t H m) = «kwi 2 = 2« mat)) - uwm)) > 2«mo- 

Hence fi(t) > e 2a */i(0), V* > 0. Then ||C(t)|| 2 > e 2at fx(0) and e- at \((t)\ 2 — > 
+oo as t — > +oo. Hence £(•) ^ " □ 

Definition 2 Extremal locus of the functional 3 a is the subset £ a of T*M 
filled by those trajectories of the flow e tt)a that satisfy one of the conditions 
1-3 of Lemma 1 (and hence all these conditions). 

Corollary 2 S a is a compact invariant subset of the flow e tt)a , t G R. 
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The potential energy U is a Morse function if U has only non-degenerate 
critical points, i. e. the Hessian of U at q G M is a non-degenerate quadratic 
form for any q such that d q U = 0. 

Lemma 2 ylsswme that U is a Morse function and ((t) = e tt)a (((0)), tel. 
The curve £(•) zs bounded if and only if there exists lim £(t) G C#. 

This lemma is a simple corollary of the monotonicity of H along trajectories 
of the flow e*^. □ 

Next statement is an expanded version of Theorem 1; it explains the way 
the smooth optimal synthesis is constructed. 

Theorem 2 // R? < ^-1, G B H , then the flow e tf >" has an invari- 
ant exact Lagrange submanifold ^ C T*M of class C 1 such that tt\ 9 is a 
diffeomorphism of ^ on M and the minimizers are exactly positive semi- 
trajectories of the dynamical system q = V(q), where V = 7r* (f) Q |^). More- 
over, Ch C \& C £ a ; if U is a Morse function then ^ — £ a . 

Remark 1. Submanifold $ C T*M in Theorem 2 is the graph of an exact 
1-form on M, i.e. — {d q u : q G M}, where u is a C 2 -function on M. Then 
u is a solution of the modified Hamilton-Jacobi equation: 

H{du) — au = const. 

Indeed, let q G M; then T dqU ^ is a Lagrange subspace of T dqU (T*M) and 
i) a e T dqU ^. Hence 

= <r(£, i) a ) = <t(Z, H) + a<r(Z, e) = (d dqU H - ad q u, £) , V£ G T^tt. 

We obtain that d(H(du) — au) = 0. The choice of const is at our dis- 
posal. If we set const = 0, then — u(q) = min ^3 a |n«) , Vg G M. In- 
deed, min (^3 a \ na ^j = 3 a (l), where j(t) = ir o e tf,a (g). We have: 3 a (l) — 

OO oo 

/ e~ at ((d y(t) u, 7(0) - dt = / (e- at | M ( 7 (t)) - e-« t a«( 7 (t))) dt = 



oo 

H(e- at u(l(t))) cft = -«( 7 (0)). 
o 

Standard Hamilton-Jacobi equation corresponds to a = 0. As we know, 
in general, this equation does not have smooth solutions, it has only gen- 
eralized ones. It would be very interesting to study transformations of the 
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solutions for the parameter a running from the indicated by Theorem 2 
"smooth area" to 0. 

Remark 2. The Hamiltonian H is the energy of a natural mechanical system 
on the Riemannian manifold and the discount factor a plays the role of a 
negative friction coefficient. Moreover, the change of variables z \— > —z, z G 
T*M, q G M, transforms f) a in — h_ a that allows to apply our analysis of 
the flow e ti)a to the dissipative mechanical system (with a positive friction 
coefficient). As a byproduct we obtain the description of the subset of T*M 
filled by the bounded trajectories in the case when the friction coefficient is 
greater than certain critical value. 

3 Partial hyperbolicity 

We start to prove Theorem 2. The Levi Civita connection V on T*M defines a 
smooth "horizontal" vector distribution D — (J D z on T*M, where D z is 

zeT'M 

the subspace of T Z (T*M) filled by the velocities of the parallel translations of 
z along the curves in M. We denote: A z = T z (T* (z) M) and call A = [j A z 

z£T*M 

the vertical distribution. Then T Z (T*M) = A z © D z , G T*M. 

Note that both A z and D z are Lagrange subspaces of the symplectic 
space T Z (T*M). This is evident for A z ; in what concerns D z , its property 
to be a Lagrange subspace is just another way to say that the Levi Civita 
connection is symmetric (i. e. torsion free). A vector distribution on a subset 
of the symplectic manifold is called a Lagrange vector distribution if its fibers 
are Lagrange subspaces of the tangent spaces. 

Let w G T Z (T*M), w = w ver + Whor, where w ver G A z , Wh or £ D z . We 
set \w\ = \w ver \ + {ir^Whorl and thus define a canonical Riemannian structure 
on T*M. 

Proposition 1 Assume that < ^-1, \/z E Bh- Then there exist contin- 
uous Lagrange distributions E ± = [J Ef on £ a and positive constants c±, e 

Z££ a 

such that: 

1. e t ^E ± = E ± , Vt G K. 

2. \ef a W-\ < c_e ( f _e) '|w_|, \ef a w + \ > c + e ( f +e)t \w + \, V w± G E ± , t>0. 

3. EfnA z = 0, \/z G S a . 
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Proof. Recall that e^" a = e at a; hence e 1 ?" transforms Lagrange subspaces 
of the tangent spaces to T*M in the Lagrange subspaces. We define the 
Jacobi curves and the curvature operators in the same way as for the Hamil- 
tonian flow (see Appendix). Namely, let z G T*M; then 

is a monotone decreasing curve in the Lagrange Grassmannian L (T Z (T* M)) 
and R%> = R jt)a (0) is a self-adjoint operator on A z . Obviously, Rjt, a (t) = 

e^<* R\ a e i y | ji (t) and R%> =Rf. 
Lemma 3 R%> = i?f - ^1 . 

Proof. We set D" = (J| a )°(0) G L(T Z (T*M)), D a = \J D z , the 

zeT'M 

canonical Ehresmann connection associated to the flow e tt)a . Then D° = D, 
the Levi Civita connection. 

Let O z be a neighborhood of z in T*M and v a (z'), z' G O z , a smooth 
"vertical" vector field. According to the terminology described in the Ap- 
pendix, the field v a is parallel for the connection D a along trajectories of the 
flow e tt>a if and only if [f) Q ,t> a ] G D a . The connection D a is characterized by 
the following property: if v a G A and [J) a ,i> a ] G -D a , then [f) a , [f) a , i> a ]] G A. 
Moreover, 

[KAK,v a ]]{z) = -R z a v a (z). 

Let v be a vertical vector field on O z that is parallel for the Levi Civita 
connection D along the trajectories of the flow e ti)0 and is constant on the 
vertical rays (R+Ct) H 2 , where ( t = e ti)a (z) is any point of the contained in 
O z interval of the passing through z trajectory of the flow e tt)c ". Recall that 
tz' = exp ((lnr)e) (V), r > 0, z' G T*M, where e is the Euler vector field. 
The linearity of the Levi Civita connection implies: exp(se)*.D = D, Vs G M.. 
Hence 

[e,v] = -v, [e,[f) ,v]] = 0. 

Now I claim that the vector field v a defined by the formula v a (( t ) = 
e^*v(Ct) is parallel for the connection D a along the curve ( t - Indeed, 

[t) a ,v a ](tt) = [i)o + ae,v a ](Ct) =e ft (foa,u](Ct) - f w (Ct)]) , 
[&«, [*)«,««]]&) = ef« (^1 - rA v(C t ) G A c , 
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We have obtained the desired formula R^ a = R z — 2-1 and the following 
characterization of D a : 

Ct 

D a z = span{[t) ,v](z) - -v(z) : v G <U }, (4) 

where QJo is the space of vertical vector fields on O z that are parallel along 
the flow e tt>0 for the connection D = D° and are constant on the vertical rays 
{r( t :r,teR, CtMte O z }. □ 

Next lemma is a simple generalization of the hyperbolicity test of Lewow- 
icz and Wojtkowski (see [H Th. 5.2]). The proof is almost verbal repetition 
of the proof from the cited paper and we omit it. 

Let N be a Riemannian manifold, X G VeciV, and Q : TM ^la pseudo- 
Riemannian structure on N (i. e. a smooth field of nondegenerate quadratic 
forms Q z : T Z N -> R, z G N). Let L x q : v i-> |Q(e^)| t=0 , v G TM, be 
the Lie derivative of Q in the direction of X. 

Lemma 4 Let (5 G R and S G N be a compact invariant subset of the flow 
e tx , £ G R. // £/ie quadratic form LxQ — f3Q is positive definite on TN\ S 
then there exist invariant for the flow e tx continuous vector distributions 
E ± = |J Ef on £ a and positive constants c±,e such that (— 1) ± <5| £; ± > 

ze£ Q 

and 

\e\ x w-\ < c_e ( §" e)t |m_|, |e^w+| > c + e ( ^ +£) V+l, V w± G £ > 0. 

Next lemma is a generalization of the earlier observation of Piotr Przy- 
tycki (see [21 Lemma2.1]). Let now iV be a symplectic manifold endowed 
with the symplectic form a, X G VecM, (3 G R, and L^cr — /3cr. Let 
A* = |J A*, A* G L(T Z N), i = 0,1, be two smooth Lagrange distributions 

on N. We assume that A° n A* = 0, V;z G AT. 

Let f G T^A", then t> = t> + t>i, where f« G A*. We define the pseudo- 
Riemannian structure Q\o A i on A" by the formula: 

Q A o A i(v) = o-(v ,«i), W G T Z A^, z E N. 

We define the distributions A*(£) = e^'^A*; then £ A* (£) is a curve in the 
Lagrange Grassmannian L(T Z N), Mz G N, % — 0, 1. 

Lemma 5 Le£ S G N be a compact invariant subset of the flow e tx , £ G R. 
// £/ie curve A° z (-) is monotone decreasing and the curve A^(-) zs monotone 
increasing, G 5*, then the form Q\o A i satisfies conditions of Lemma 4- 
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Proof. Let V G VecN, V\ s = V° + V\ where V i e A*. We set V(t) = 
e -txy^ yi^ = e -txyi^ y ^ = v^q + V^, V\t) = V^t^ + V^t),, where 

V\t) j e A*, i,j = 0,1. We have: {L x Q A o A i)(V) = f t a (V(t) u V(t) Q )\ t=0 
and (3Q A » A .(V)=(3a(V°,V 1 ) = |<7 {V\i), V°(t))\ t=Q . Then 

o (V(t) u V(t) ) = a (V(t) u V(t)) = a (V(t) 1 , V\t)) + a {V{t) u V°(t)) 

= a V\t)) - a (V(t) , V°(t)) + a (V(t), V°(t)) 

= a (V(t) l7 V\t)) - a (V(t) , V°(t)) + a (V\t), V°(t)) . 
The differentiation with respect to t at t — gives: 

(^xQaoaO (V) = A\v r ) - a\v°) + PQ A o A i(V) 

and the monotonicity assumptions imply that A°(V ) < 0, ^(V 1 ) > 0. □ 
Note that the manifold A" = T*M, vector field X = h a , invariant subset 
S = £ a , constant (3 = a, and distributions A = A, A 1 = D a satisfy 
conditions of Lemmas 4 and 5 if Rf < sl./, \fz e £ a - Let E ± be the 
invariant distributions guaranteed by Lemma 4. To complete the proof of 
Proposition 1 it remains to show that that Ef are transversal to A z Lagrange 
subspaces. 

We'll prove a little bit more. Namely, we are going to show that: 

Ef= lim J*«(t)= lim (J*»)°(t), Vze£ a . (5) 

Indeed, as we know (see Appendix) the limits lim Jz a {t) = J% a (±oo) and 

lim (J^ a )° (t) = (Jz a )° (±oo) do exist and are transversal to A z = J% a (0). 

Moreover, J^ a (±oo) and (J z a ) (±oo) are invariant vector distributions for 
the flowed, since J^(t + s) = e~ tl)a Jk(s), (J 6 *) (t + s) = e~ tl>a (J^)°(s). 

Take a vector field V = + where ^6^. If V^z) ^ 0, Vz e £ a , 
then the component e t J )a V + G £ + of the vector e^ a V = e t J )a V + + e^V' 
dominates as t — ► +oo and the component ^ a V~ dominates as t — ► — oo 
due to the already proved estimates (see Lemma 4). 

Therefore in order to prove (5) it is sufficient to show that J^ a (t) n E ± = 
(J^Y (t) n E ± = for some (and hence for all) tel. 

We have: QAD<*\jf> a (p) = QadAa = and ^Qad« | jf, a(0 ) < 0. Hence 
QAD a \jt) a ( t ) < for small positive t and QAD a \jf> a (t) > f° r small negative t. 
On the other hand, Q\ E+ > and Q\ E _ < 0. It follows that J f)a (t) n E + = 
J^(t) nr = 0. Similarly (J»<*)° (t) n E+ = (j*>«)° (t) n E~ = 0. □ 
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Corollary 3 Under conditions of Proposition 1, t) a (z) G E z , Wz G S a . 

Proof. Let fj a = f>+ + fj", where f)±(z) G € £ a . Then the length 

of the vectors e^h^z) = i)^(e tt,a (z)) is uniformly bounded as t tends to 
+00. On the other hand, |e*k*l)+(;z)| > c + e^ +£ ^\i)+(z)\ for all t > 0. Hence 
h+(^) = 0, V^G^ a . □ 

4 Optimal synthesis 

Now we are going to consider variational problems with finite horizons and 
"free endpoints" and then to study the limit as the horizon tends to infinity. 
Namely, we study the functionals 

Z'-l^J e~ at Q|7(*)| a -f(7(*))) dt 


on the spaces VL^' T = {76 if 1 ([0, r];M) : 7(0) = q}. Compactness of M 
implies the existence of minimizers that are critical points of 3 T a on fi"' T . 
These critical points are solutions 7 of the Euler-Lagrange equations such 
that the transversality condition 7(7-) = is satisfied. In other words, critical 
points are projections to M of solutions ( to equation (3) such that ((t) 
belongs to the zero section of T*M. Note that ((t) G B H , W G [0,r]; 
indeed, if a solution leaves Bh, then it never comes back (see the prove of 
Lemma 2). In the sequel, we identify M with zero section of T*M, i.e. 
M = {0 q : q G M}, so that M C T*M. 

Proposition 2 Assume that Rf < ^1, \fz G B H . Then e~ rf > a (M) is a 
smooth section of the bundle tt : T* M — > M , Vr > 0; /ience /or any q & M 
there exists a unique critical point of 1 T a on Qg' T '. 

Proof. It is sufficient to show that the map tt o e~ t ^ a \ M : M M has no 
critical points, V£ > 0. Indeed, in this case the maps rr o e~ ti)a \ M must be 
coverings of M and n\ M = id; hence ■Koe~ tf)a \ M are actually diffeomorphisms. 

So we have to show that e~ ti)a T 0q M n A e t(, a ( 0q ) = for any q G M. 
To this end (and for further limiting procedure) we introduce the Lagrange 
distribution A a = \J C T(T*M) as follows: 

A° = span { (l + u - [f, ,u] : f G 2Jo| , ^ G T*M, 
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where 2Jo has the same meaning as in (4). Consider the splitting T(T*M) = 
A a © D a . Symplectic form a defines the nondegenerate pairing of the sub- 
spaces A" and D" that gives the identification A" = (D a )*. 

Then any transversal to A" Lagrange subspace A C T Z (T*M) is identified 
with the graph of a self-adjoint linear map from D° to A" = (D a )* and thus 
with a quadratic form Qa on D". 

Lemma 6 We have: Q D? = 0, Q Az > 0, Q Dz = ^Qa z , Vz G T*M. In 
particular, Qd<* < Qd < Qa- 

Proof. The equality Qd% = is obvious. Let £ G D", then £ = [f)o,i>](z) — 
^v(z) for some ti G 2Jo ( se e (4)). Assume that £ ^ 0, then i;(z) 7^ 0. 
Moreover, G A z and v(z) = ((1 + |)t> — [f)o,f]) + ([f)o,f] — ff) , where 
((1 + f )u - [f) , «]) G A", ([h , u] - f u) G D". Then 

Qa,(0 = <7* ((l + |) U - [fj0,«] , [t)0,v] - = <T z ([fjo,u],u) > 0. 

Similarly, = ^^([f)o, □ 

Note that T 0(J M = D 0q , Vg G M, since the Levi Civita connection D is 
a linear connection. Let z = e~ Tt)a (0 q ), ((t) = e tf)a (z); then t i— > Jz a (t) = 
e~ T k*A£( t ) is a monotone decreasing and t h- > (Jj" a ) (i) = e~ r k*.D°, t x a mono- 
tone increasing curves in the Lagrange Grassmannian L(T Z (T*M)). We'll 
use simplified notations: 

A(t) = e;^A m , D a (t) = e-**D a m , D(t) = e^D m . 

Then t i— > <5a(<) is a strongly monotone decreasing and £ i— > <5d«(*) a strongly 
monotone increasing families of quadratic forms. Moreover, Qa{{) —Qo(t) and 
Qz>(t) — QD a (t) are nondegenerate quadratic forms since £)(£) is transversal 
to A(t) and L> a (t). It follows that 

Qd<*(o) < QD a (t) < QD(t) < QA(t) < Qa(o), Vt > 0. (6) 

In particular, D{t) = e~ T ^ a D 0q is transversal to A(0) = A z . Proposition 2 
is proved. □ 

Given q G M we denote by <& T (q) the value at q of the section e~ ri,a (M) 
of T*M; in other words, {$/(<?)} = e _T ^(M) n T ? *M. Recall that $ r (<?) G 
Bh, Vg G M, r > 0. In particular, r i— > $ r (g), r > 0, is a uniformly 
bounded curve in T*M. 
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Lemma 7 Assume that z = lim & Tk (q) for some r k — > +00 as k — > 00. 

k^oo 

Then z G S a and E~ = lim § Tkif {T q M). 

fe^oo 

Proof. Let 7 (t) = tt o e^{z), 7fc (t) = tt o e tf >° ($ Tfc (g)). Then T a ( lk ) < 
T a { lk ){const) = l{e~ at - l)U(q) < ±\U(q)\. Hence 3£( 7 ) = lim T a { lk ) < 

^\U(q)\, Vr > 0. We obtain that 3 Q ( 7 ) < ^\U(q)\. In particular, 7 G 
and, according to Lemma 1, z G £ a . 

The subspace <& Tk ^{T q M) C T$ r (q)(T*M) is the tangent space to the sub- 
manifold e~ Tfc ""(M), i.e. § Tkif (T q M) = e; Tfcf >«(A, 7fc(Tfc) )- Now the statement 
of the lemma follows from (5) and (6). □ 

Recall that $ r (M) is an exact Lagrange submanifold of T*M, hence 
S I$ T (M) * s an exac t 1-form, where s is the Liouville form on T*M. In other 
words, $ r = da T for a smooth scalar function a T on M. Lemma 7 together 
with statement 3 of Proposition 1 imply that second derivatives of a T are 
uniformly bounded for all r > 0. 

The functions a T are defined up to a constant and we may of course 
assume that they are uniformly bounded on M. Then there exists a sequence 
Tfc — > +00 as k — > 00 and function G C l,ao (M) such that a Tk — ► as 
fc — > 00 in C 1 -topology. Set ip(q) = dgO^, then ijj(q) = lim $ Tfe (g), Vg G M. 

We obtain that ip(q) G £ a and $ Tfc;)i (T g M) — > ^M q ) as ^ — > 00 ' ^ e 

Hence the function is actually of class C 2 ; the submanifold \I/ "= {VK?) : 
q G M} is contained in £ a and T z \l/ = E~ , Vz G f . 

According to Corollary 3, f) Q (-z) G hence * is an invariant exact 
Lagrange submanifold of the flow e'^", t £ 1. Moreover, ^ D Ch since 
C7 H = e r ^(C^) C e r ^(M), Vr > 0. 

If U is a Morse function, then any fixed point z = q G Ch of the flow 
gtfia j s hyperbolic with real eigenvalues. This is immediately seen after the 
diagonalization of the Hessian of U in the critical point q by the orthogonal 
transformation of T q M. The stable subspace of the linearization of b a at z 
is contained in E~ = T z ^> . Hence the stable submanifold of the hyperbolic 
equilibrium z is contained in \1/ C S a . On the other hand, S a is the union 
of the stable submanifolds of all equilibria z G Ch (see Lemmas 1,2). We 
obtain that ^ = £ a . 

Figure 5 illustrates the structure of S a near an equilibrium point z. The 
stable subspace of the linearized system is always contained in E~ = T z S a , 
while the unstable subspace splits in the "less unstable" part that is contained 
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Figure 5: 



in E~ and the "more unstable" part that is equal to E+. 

We have proved all good properties of S a stated in Theorem 2. It remains 
only to check that the curves t i— > 7r o e tt)a (z), z G £ a , are minimizers. To do 
that, we use the classical "fields of extremals" method. We set: 

C = {( e - at z,t) :zeS a , t > 0} C T*M x R+. 

Then C is an n-dimensional submanifold of T*M x M + and 1-form 

(s — e~ at Hdt) is exact. 
c 

Given q G M, there exists a unique z £ £ a such that 7r(^) = g. We set 
7 (£) = 7r o e tf,Q (z) and we have to prove that 3 a (j) < 3 a (o), ^8 £ ^ such 
that p 7^ 7. 

Let 

C(t) g £ Q n r 7(t) M, G^ a n r tf(t) M 

be the lifts of 7 and g to £ a and 

C(«)= {e~ at at),t), fj(t) = {e- at v(t),t) 
be the lifts of j(t) and to C. Then 



at Hdt) = / e- at ((C(t),7W) - H(((t)))dt = J ( 7 ) 
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and 



oo 

J(s- e~ at Hdt) = J e- at (( V (t), e(t)) - H(rj(t))) dt < 3 a (g). 



Now, Vr > 0, we define the curves ( T : [0, 2r] — > C and fj T : [0, 2r] — > £ by 
the formulas: 



*7r(f) 



CW, o < t < T, 

(e— C(2r-0,r), r < t < 2r; 

7)(t), < t < r, 

(e-°X2T -t),r) , r<t<2r. 



The curves Cr and r} T have common endpoints, hence 

J (s - e- at Hdt) = J{s - e~ at Hdt). 



Cr 



We have: 



T 

f { ,-e-~H«)= f { ,-e-~H*)-,~f m , m) * 



»?I[0,t] 



and 



T r 

J (r)(t),g(t))dt\ <ce-f r J \e-^g(t)\ 



dt 



<ce-^ T V^ij e' at \g(t)\ 2 dt 
where c = max{|z| : z G S a }. Hence 



J{s- e' at Hdt) = J (s - e~ at Hdt) 



lim / i s - < 

T^ + OO 

V 
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and similarly 

lim J(s- e- at Hdt) = J{s - e~ at Hdt). 



Summing up, we obtain: 

3 a (i) = J{s - e~ at Hdt) = J(s - e~ at Hdt) < 3 a (g). □ 

Appendix 

Here we collect some definitions and geometric facts that are used in the 
paper; see [1] and references therein for the consistent presentation. 

Monotone curves in the Lagrange Grassmannian 

Let £ be a 2n-dimensional symplectic space endowed with a symplectic 
form cr. A Lagrange subspace is an n-dimensional subspace A C £ such 
that a\ A = 0. The set of all Lagrange subspaces forms a compact n ( n + 1 ) - 
dimensional manifold that is called Lagrange Grassmannian and is denoted 
L(S). Symplectic group acts transitively on the Lagrange Grassmannian; 
moreover, symplectic group acts transitively on the pairs of transversal La- 
grange subspaces. 

Let II e the symplectic form defines a non-degenerate pairing of II 

and E/IT: the scalar product of x G II and the residue class y + II is equal 
to a(x,y). We obtain a natural identification E/II = II*. Now set: 

= {A g l(e) : nn A = 0}; 

then 11* is an affine space over the vector space Sym(E/II) of linear self- 
adjoint maps from E/II to II = (E/II)* (or, in other words, over the space 
of quadratic forms on E/II). Indeed, the sum of A G 11* and S G Sym(E/II) 
is defined as follows: 

A + S = {S(y + Il) + y : y e A} e L(Z). 

An affine space is a vector space "with no origin". Let us take A G IT 11 
and order A to be the origin. Then 11* turns into Sym(E/II). Moreover, 
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obvious isomorphism E/IT = A induces the isomorphism of Sym(E/n) with 
SymA and the isomorphism of II with A*. This makes 11* a coordinate chart 
of the manifold L(E) coordinatized by Sym(A). 

Given Aj G 11*, i — 0, 1, let Q\ t G Sym(A) be the coordinate presentation 
of Aj; then dim(A fl Ai) = dimker(<5A — QaJ- 

Let V G Ta L(E). To the tangent vector V we associate a quadratic form 
V_ on A (or, in other words, a self-adjoint map from A to Aq = S/A ) as 
follows: take a smooth curve A t G £(£) such that Aq = V and a smooth curve 
x t G A 4 and set V_(xq) = <j(x ,x ). Then V i— > V is a natural isomorphism 
of T Ao L(S) and Sym(A ). 

A curve £ i— > A t is regular if A t is a non-degenerate quadratic form. A 
regular curve is monotone increasing (monotone decreasing) if A t is positive 
definite (negative definite). 

Let LT fl A t = 0, then A t belongs to the affine space IT* and the derivative 
A t belongs to the vector space Sym(E/IT). Obvious isomorphism E/II = A t 
induces the isomorphism Sym(E/II) = SymA i; which transforms A t in A ( . 
In particular, a monotone increasing (decreasing) curve is presented by a 
strongly monotone increasing (decreasing) family of quadratic forms in any 
coordinate chart LT*. 

Let t I— > A t be a regular curve in L(E) and r G R; then At G A* for all t 
that are sufficiently close and not equal to r. We can treat 1 1— > A t as a curve 
in the affine space A* with a singularity at t — r. This singularity is actually 
a simple pole. We can write the Laurent expansion of A t at t — r in this affine 
space (that is an affine space over the vector space Sym(E/A r )). All terms 
of the Laurent expansion but the free term are elements of the vector space 
Sym(E/A r ), while the free term is an element of the affine space A* itself. 
We denote this free term by A° and call the curve r i— > A° the derivative 
curve of the curve A.. 

Given t G R, the derivative curve defines a splitting: E = At © A£ , which 
induces the identifications 

A° = E/ At = A,*, At = E/A° = A°*. 

Then 

A t : At - A°, A; : A° - A t 

are self- adjoint linear maps. The operator R\(t) : A t — > At defined by the 
formula 

i4(0 = -A t °°At 
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is the curvature operator of the curve A.. 

Assume that t i— > A t is a monotone curve, then |A t | is a positive definite 
quadratic form on A t and the curvature operator R\(t) is a symmetric oper- 
ator with respect to the Euclidean structure defined by this quadratic form. 
In particular, the operator R\(t) is diagonalizable and all its eigenvalues are 
real. We say that the monotone curve A. has a positive (negative) curvature 
if all eigenvalues of -Ra(^) are positive (negative) and uniformly separated 
from 0. If a monotone curve A. has a positive (negative) curvature, then the 
curve A° is also monotone and the direction of monotonicity of A° coincides 
with (is opposite to) the direction of monotonicity of A.. 

Let t i— > A t be a regular curve and t i— > A t another curve in L(E) such 
that A t nA( = 0, Vt G R. We may treat {(t,A t ) : t 6 1} C 1 x S and 
{(t, A t ) : £ G 1} C 1 x E as subbundles of the trivial vector bundle IxE; 
these subbundles define a splitting of the trivial bundle. We say that the 
"section" x t G A t , t G R, is parallel for the splitting E = A t © A t , t G R, if 
i t G A t , Vt G R. 

Canonical splitting E = A t © A£ can be characterized as follows: the 
relations Xt G At, if £ A { , Vt G R, imply the relation i t G A t if and only 
if A t = A1, Vt G R; moreover, x t = —R\(t)x t in the case of the canonical 
splitting. 

Theorem Let A t , t G R, fre a monotone curve in L(E). If The curve A. 
has negative curvature, then there exist lim A t = A ioo = lim A£ and 

A, n A T = 0, V-oo<t<r< +oo. 

The existence of the limits and the fact that A t , t G R, are mutually 
transversal can be easily explained. Recall that symplectic group acts tran- 
sitively on the set of pairs of transversal Lagrange subspaces and that co- 
ordinate presentation of a Lagrange subspace A G £(E) is a quadratic form 
Q\. Assume that the curve t i— > A t is monotone decreasing and the curve 
t i— > A£ is monotone increasing (the opposite "increasing-decreasing" case 
is treated similarly). We can always find an appropriate coordinate chart 
such that Qa — Q\° > 0. Moreover, t i— > <5a 4 is a strictly monotone de- 
creasing family of quadratic forms, while t i— > Qa« is a strictly monotone 
increasing family, and Qa ( — <5a° & re non-degenerate forms. Hence A t and A^ 
never leave our chart for positive t and there exist lim Q^ t > lim Q\° . A 

more carefull analysis shows that these two limits coincide and convergence 
to the common limit has an exponential rate. The limiting procedure as 
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t — > — oo is performed similarly: we simply take a coordinate chart such 
that Q Ao - Q A o < 0. 

Jacobi curves 

Let M be a smooth n-dimensional manifold and T*M its cotangent bundle 
equipped with the standard symplectic structure. Given q G M and z G T*M 
we set S z = T Z (T*M), A z = T Z (T*M); then S z is a symplectic space and 
A z is a Lagrange subspace of this symplectic space. 

Let ft : T*M -^Mbea smooth (Hamiltonian) function, ft G Vec(T*M) 
the associated to ft Hamiltonian vector field, and t h- > e tfe the generated by 
ft, Hamiltonian flow on T*M. Jacobi curve J z {t) is a curve in the Lagrange 
Grassmannian L(E Z ) defined by the formula: 

4(t)=e-/ h A etHzV tern. 

We list some easily derived from the definition basic properties of the 
Jacobi curves. Let ((t) = e th (z), ((t) G T*^M; then quadratic form 

jf (0) on jf (0) = A z is equal to — d 2 z (ft| T * M j and quadratic form if (i) 
on jf (i) is obtained from —d\(t) {Ht* m) by ^ ne li near change of variables 

e~ th : A^( t ) — > J^ 1 (t). It follows that Jacobi curve J z (t) is monotone decreas- 
ing (increasing), \/z G T*M, if and only if ft| T * M is strongly convex (concave), 
Vg G M. Other properties: 

jf (t) = e^(4))°(0), i2 jJt (f) = ef h R fh (0)e? | jK(t) . 

Lagrange distribution (0), z G T*M, on T*M is called the canonical 

— * 

connection associated to ft and linear operator i? J s(0) : A z — > A 2 is called 

— * 

the curvature operator of ft at z G T*M. We will use simplified notations: 

Aj = Jf(0), i£ = ^(0); 

, — » 

then S z = A z © A£, z G T*M, is the associated to ft canonical splitting of 
the vector bundle T(T*M). 

Any vector field / G Vec(T*M) splits in the vertical and horizontal parts 
as follows: / = f ver + f hor , where f ver (z) G A 2 , //^(z) G A h z , \Jz G T*M. 
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Now let v G Vec(T*M) be a vertical vector field, i. e. v h or = 0; we say that 
the field v is parallel for the connection A h along trajectories of the flow e*^ 
if [/, v] ver = 0. 

Horizontal vector fields and parallel vertical vector fields can be defined 
for any Ehresmann connection (i. e. for any vector distribution D on T*M 
such that S z = A z © D z ). The associated to h canonical connection is 
characterized by the following property: if Vh or = and [h,v] ver = 0, then 
[h, [h,v]] hor = 0. 

Finally, for any vertical vector field v and any z G T*M we have: 
R h z v(z) = -[h, [h,v] ver ] hor (z). 

Example. Let M be a Riemannian manifold and H : T*M — > H. the energy 
function of a natural mechanical system on M, i.e. H(z) = ^\z\ 2 + U{q), 
\/q G M, z G T*M, where U : M -> R is the potential energy. Then A H 
is actually standard Levi Civita connection V rewritten as an Ehresmann 
connection on T*M. More precisely, is the subspace of S 2 filled by 
the velocities of the parallel translations of the covector z along curves in 
M. Moreover, Riemannian structure gives the identification T*M = TM. 
Combining this identification with the identification T*M ^ T Z (T*M) = A z 
of the vector space T*M with its tangent space we obtain the explicit formula 
for the curvature operator Rjf of the Hamiltonian field H at z G T*M: 

R H Z =X(.,z)z + V 2 q U, 

where 9t is the Riemannian curvature and V 2 is the second covariant deriva- 
tive. 
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